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5 Background 

Field of the Invention 

This invention pertains in general to telephony and televideo conferencing and in 
particular to performing acoustic echo cancellation on potentially distorted audio signals. 


10 Background Art 

Two-way audio communications systems, such as speakerphones and video 
communications systems having audio capabilities, utilize both a microphone and a 
loudspeaker. The microphone transmits speech and other sounds from the local terminal 
to remote terminals while the loudspeaker emits sounds received from remote terminals. 

15 In a typical hands-free system, the loudspeaker and microphone are located in close 
proximity and sounds produced by the loudspeaker are picked up by the microphone. 
Without signal processing, therefore, a feedback loop is easily created between the 
loudspeaker and microphone. This feedback can cause the loudspeaker to emit an 
undesirable "howling" noise and cause the remote terminals to hear echoes. 

20 One simple technique for eliminating feedback is to provide half-duplex switching 

where only the microphone or the loudspeaker is active at any given instant. In a typical 
half-duplex system, the loudspeaker is active imtil a sound is detected at the microphone. 
Then, the loudspeaker becomes inactive and the microphone becomes active for the 
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duration of the sound. Half-duplex systems have many inherent problems, not the least of 
which is that a sUght noise may unintentionally cause the loudspeaker to cut out. As a 
result, it is often difficult to conduct a normal conversation with a system using half- 
duplex switching. 

5 More sophisticated audio communications systems use acoustic echo cancellation 

(AEC) to reduce echoes and eliminate howling. An AEC system typically utihzes a 
sample-by-sample copy of the signal going to the loudspeaker as the basis for an estimate 
of the echo returning through the microphone, as taught in U.S. Patent No. 4,965,822, 
entitled FULL DUPLEX SPEAKERPHONE, which issued on October 23, 1990 and is 

10 incorporated by reference herein. This estimated echo is subtracted on a sample-by- 
sample basis in an attempt to separate out only that portion of the microphone signal due 
to sounds coming from sources other than the speaker. An adaptive AEC uses a filter 
having slowly adjusted weights to form the echo estimate in an effort to more accurately 
subtract the echo from the returned audio signal. Subsequent conditioning performed on 

1 5 the output of the AEC may include automatic gain control (AGC) and perceived noise 
reduction. 

A problem with the above approach is that the loudspeakers do not produce sound 
pressure signals that are exactly proportional to the driving voltage (or current). 
Likewise, microphones are imperfect in an analogous sense. There may also be other 
20 sources of distortion within the sound system, such as amplifiers, analog-to-digital (A/D) 
and digital-to-analog (D/A) converters, and perhaps even the user's environment. 
Existing AEC systems do not accurately remove the nonlinear components of the returned 
signal due to these sources of potential distortion. As a result, a badly distorted form of 
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the echo can pass through the echo cancellation process. Another undesirable effect of 
these introduced distortions is that the adaptation of the AEC parameters is degraded, 
leading to a greater perceived echo. 

One potential solution to the problem of degraded AEC adaptation is to use a 

5 reduced adaptation rate during periods of very loud sound output. This technique is used, 
for example, in U.S. AppHcation No. 09/XXX,XXX, entitled APPARATUS AND 
METHOD FOR CONTROLLING AN ACOUSTIC ECHO CANCELER, filed on 
January 20, 2000, and incorporated by reference herein. However, reducing the 
adaptation rate has the undesirable effect of slowing the system's response to a changing 

1 0 acoustic enviromnent such as when users are in motion and/or the room temperature 
fluctuates. 

Another potential solution is to use higher quality loudspeakers and other 
components. This solution, however, carries with it considerable expense and places 
severe hmitations on the designs of the equipment. High-quality loudspeakers are 

1 5 typically large and heavy and generate strong external magnetic fields. Often, the audio 
communications system is integrated into another sound system, such as the audio 
subsystem of a laptop computer, where a high-quality loudspeaker cannot be used. 

Therefore, there is a need for a technique for more accurately estimating the echo 
when performing acoustic echo cancellation. There is also a need for a technique for 

20 more accurately adapting the estimated echo in response to changing acoustic 
characteristics. 
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Disclosure of the Invention 

The above needs are met by using modules to estimate the nonlinear distortions in 
the audio signal returned from the microphone that were introduced by the loudspeaker, 
microphone, and related components. 

5 A typical audio communications system has a plurality of terminals coupled to a 

switch. The terminals can include, for example, dedicated speakerphones, desktop 
handsets with or without speakerphone capabilities, cellular phones, and/or personal 
computer (PC) systems with audio capabihties. The switch may be dedicated to audio 
communications, as is a private branch exchange (PBX), or distributed and 

1 0 multifunctional, as is an hitemet server. 

Each terminal preferably includes a microphone and a loudspeaker. An amplifier 
ampUfies the electrical signals produced by the microphone and provides its output to an 
AID converter. The A/D converter outputs equivalent digital samples. The loudspeaker 
is driven by another amphfier which, in tum, is driven by the output of a D/A converter. 

1 5 The D/A converter receives digital samples representing the sound pressure waves to be 
produced by the loudspeaker. 

In order to cancel echoes of the loudspeaker picked up by the microphone, the 
audio communications system has an acoustic echo cancellation (AEC) module. The 
AEC module can be located in the terminal or elsewhere in the audio communications 

20 system. U.S. Patent Application No. 09/660,205, entitled COMMUNICATIONS 

SYSTEM AND METHOD UTILIZING CENTRALIZED SIGNAL PROCESSING, filed 
on September 12, 2000, and incorporated by reference herein, describes potential 
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locations of the AEC module. The AEC module preferably receives the digital signal 
sent to the loudspeaker and the digital signal received from the microphone. 

The digital loudspeaker signal is processed by an audio generation module (AGM) 
to model the substantially nonlinear distortions that can occur during the process of 

5 playing the audio signal at the loudspe^er. The AGM includes a modehng path 

comprised of one or more distortion modules. Each distortion module receives digital 
samples as input, modifies the samples to model a form of distortion, and outputs the 
modified samples. A distortion module can be adaptive or it can be partly or wholly pre- 
estabUshed. Preferably, the AGM can add or remove distortion modules from the 

1 0 modeling path at any time in response to characteristics of the digital samples or under 
direction from other modules. Distortions that can be modeled by the distortion modules 
in the AGM modeling path include, for example, amphfier clipping, loudspeaker voice 
coil displacement, harmonic distortion introduced by the loudspeaker, and hysterisis in an 
iron-core inductor. 

1 5 The AGM outputs digital sample values to an acoustic echo estimation (AEE) 

module. The AEE module preferably uses known adaptive algorithms to adapt the digital 
samples to compensate for substantially linear changes in the echo characteristics of the 
environment in which the loudspeaker and microphone are located. For example, the 
AEE module can modify the digital samples to account for changes in echo attenuation 

20 due to relocation ofpeople in the vicinity of the microphone. 

The output of the AEE module is received by an audio sensing module (ASM). 
The ASM performs a function similar to the AGM, except that the ASM models 
substantially nonlinear distortions that occur while sensing the audio signal. Accordingly, 
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the ASM models distortions such as microphone 1 16 centerclipping, amplifier zero 
crossing distortion, saturation in either the microphone or the ampUfier, and distortions 
introduced by the AID converter. The output of the ASM represents the estimate of the 
echo of the loudspeaker signal in the signal received from the microphone. 
5 The digital samples returned from the microphone and the output of the ASM are 

received by an adder module. The adder module subtracts the estimated echo received 
from the ASM from the samples returned from the microphone, thereby removing at least 
part of the estimated echo of the loudspeaker from the microphone signal. 

1 0 Brief Description of the Drawings 

FIGURE 1 is a high-level block diagram of an audio communications system 
according to an embodiment of the present invention; 

FIGURE 2 is a block diagram illustrating various components of the audio 
communications system including an acoustic echo cancellation (AEC) module; and 
1 5 FIGURE 3 is a lower-level view of an exemplary audio generation module in the 

AEC module. 


Detailed Description of the Preferred Embodiments 
FIG. 1 is a high-level block diagram of an audio commimications system 100 
20 according to an embodiment of the present invention. A plurality of terminals 1 1 OA-D 
are coupled to a switch 112 via communications links 1 14A-D. The terminal types can 
be heterogeneous or homogeneous. In one embodiment, the terminals include: dedicated 
speakerphones, desktop handsets with or without speakerphone capabilities, cellular 
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phones, and/or personal computer (PC) systems with audio capabihties. As used herein, 
the phrase "audio communications system" also includes video conferencing systems 
having audio capabihties. Each terminal 110, of which terminal 1 1 OA is representative, 
preferably includes a microphone 1 16A and a loudspeaker 1 18A. As is known in the art, 

5 the microphone 116 converts sound pressure waves into electrical signals and the 
loudspeaker 118 converts electrical signals into sound pressure waves. 

The communications hnks 1 14 carry audio data representative of sounds picked 
up by the microphone 1 16 and to be played by the loudspeaker 118 to/from the switch 
1 12. The communications links 1 14 may be wired or wireless. Moreover, the hnks 1 14 

10 may include dedicated private hnks, shared hnks utihzing a publicly-accessible telephone 
network, and/or links using a public or private data communications network such as the 
hitemet. Data traveling over the links 1 14 may pass through one or more switches or link 
types before reaching the switch 1 12 or terminal 110, although a preferred embodiment of 
the present invention treats a link passing through multiple links and switches as a single 

1 5 logical link. The data carried by the communications links 1 14 can be digital and/or 
analog. If the data is digital, it is preferably transmitted as a series of discrete data 
packets, such as Internet protocol (IP) packets. Li one embodiment, the digital data is 
encoded into a compressed format. 

The switch 1 12 switches and routes communications among the terminals. The 

20 switch 112 can be, for example, a private branch exchange (PBX) located at a business or 
other entity, a pubhcly-accessible switch operated by a telephone company or other entity 
providing audio commimications, or an Internet server supporting Internet telephony. 
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Thus, the term "switch" includes any device or combination of devices capable of 
providing the switching and other functionality attributed to the switch herein. 

]n one embodiment, the terminals 110 and/or switch 1 12 have one or more of the 
components found in a typical computer system, including a processing unit, random 
5 access memory (RAM), read-only memory (ROM), a storage device such as a hard drive, 
and/or other hardware and software for providing the functionaUty described herein. 
Aggregations of machine-executable code, data, circuitry, and/or data storage areas for 
performing a specific purpose or purposes are referred to as "modules." Different 
modules may share common code, data, and/or circuitry. The modules include, for 
10 example, signal processing modules, digital-to-analog (D/A) and analog-to-digital (A/D) 
converter modules, and amphfier modules. Modules may hold in their storage areas 
previous values of signals and current statistics derived therefrom. Modules can also use 
adaptive techniques, or training, to perform the modules' functionahties. As used herein, 
the terms "adaptation" and "training" are interchangeable and refer to acting on a signal 
1 5 responsive to previous values of that signal or other signals, statistics derived from the 
signals, and/or external controls or sensors. 

FIG. 2 is a block diagram illustrating various components of the audio 
communications system including an acoustic echo cancellation (AEC) module 210. 
FIG. 2 illustrates the microphone 116 of FIG. 1 having its output coupled to an amphfier 
20 212. As is known in the art, the microphone 1 16 converts sound pressure waves into 
electrical signals. The amphfier 212 amphfies the electrical signals and provides its 
output to an A/D converter 214. The A/D converter 214 outputs digital sample values 
representative of the sound pressure waves to the AEC module 210. 
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FIG. 2 also illustrates the speaker 118 of FIG. 1. The speaker 118 generates sound 
pressure waves in response to an input received from an amplifier 216. The amphfier 
216, in turn, is driven by the output of a D/A converter 218. The D/A converter 218 
receives digital sample values representing the sound pressure waves as input from the 

5 Hnk 11 4 or another source. 

In general, the AEC module 210 estimates the echo of sounds played by the 
loudspeaker 118 that are picked up by the microphone 1 16, subtracts the estimated echo 
from the microphone's audio signal, and outputs the resulting echo-cancelled signal, hi 
one embodiment, the AEC module 210 is located in the terminal 110. Accordingly, the 

1 0 output of the AEC module 2 1 0 is passed over the communications hnks 11 4 to the switch 
112. hi alternative embodiments, the AEC module 210 is located in the switch 1 12 or 
anywhere else that echo cancellation is desired and representations of the loudspeaker and 
microphone signals are available. 

Turning to the AEC module 210 itself, the digital samples representing the audio 

1 5 signal sensed by the microphone output by the AID converter 2 1 4 are received by an 
adder module 220. The adder module 220 also receives an input 222 providing digital 
samples representing the echo from the loudspeaker 118 estimated to be present in the 
microphone signal. The adder module 220 preferably adds the negative of the estimated 
echo to the signal received from the A/D converter 214. Preferably, the adder module 

20 220 works on a sample-by-sample basis, hi one embodiment, both the estimated echo 
samples received from the input 222 and the sample values received from the A/D 
converter 214 bear sequencing information that the adder module 220 uses to match the 


9 


Case 5327 Patent 

samples. U.S. Patent Application No. 09/660,205, incorporated by reference herein, 
discloses additional details related to the sequencing information. 

The output of the adder module 220 is passed to a perceived noise reduction 
module 224. This module 224 preferable reduces perceived noise in the audio signal. 

5 Techniques for reducing perceived noise are well known in the art. 

The output of the perceived noise reduction module is preferably passed to an 
automatic gain control (AGC) module 226. As is known in the art, the AGC module 226 
preferably isolates times during which local speech is thought to be present in the input 
signal and adjusts the signal gain so that the speech is near a predetermined level when 

10 considered on average. The AGC module 226 can use adaptive techniques to perform 
AGC. The output 228 of the AGC module 226 is preferably provided to the switch 1 12 
via the communications hnks 1 14 as described above. 

The AEC module 210 also receives an input 230 carrying digital sample values 
representing the audio signal being sent to the loudspeaker 1 18 of the terminal 110. If the 

15 AEC module 210 is located in the terminal 1 10, then this input 230 is received from the 
switch 1 12 via the communications links 1 14. The loudspeaker 1 1 8 digital sample values 
are received by an audio generation module (AGM) 232 within the AEC module 210. 

The AGM 232 preferably modifies the digital sample values to model 
substantially nonlinear distortions that can occur during the process of generating the 

20 audio signal. FIG. 3 is a block diagram illustrating a lower-level view of the AGM 232 
according to an exemplary embodiment of the present invention. The AGM 232 includes 
a modeling path 310 comprised of logical interconnects among one or more distortion 
modules 312 that operate on the digital samples traveling through the path. Each 
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distortion module 312 receives digital samples as input, modifies the samples to model a 
form of distortion, and outputs the modified samples. Preferably, the AGM 232 can add 
or remove distortion modules from the modeling path 310 at any time in response to 
characteristics of the digital samples or under direction from other modules. 

5 The AGM 232 preferably models effects which are substantially nonlinear. 

Certain embodiments utihze artificial neural networks (ANNs) to achieve adaptation. 
Those ANNs which are not adaptive maybe present at the time of manufacture and do 
not require feedback for ftirther adaptation. ANNs in adaptive modules 312 utilize 
internal and/or external feedback. Such feedback may be from other distortion modules 

10 312, from the loudspeaker digital signal, and/or from the microphone signal before or 

after the adder module 220. These many possible feedback paths have been omitted from 
the modeling path 3 10 in FIG. 3 in order to clarify the teachings of the present invention. 

The example of a modeling path 310 illustrated in the AGM 232 of FIG. 3 has 
three distortion modules 312A, 312B, 312C arranged in sequence. Each distortion 

15 module 312 preferably contains a filter or other operator that acts on the input samples. 
The module 3 12 can be adaptive or it can be partly or wholly pre-established. Likewise, 
the module 312 can operate in the time or frequency domains. The module 312 can also 
act in response to short or long-term signal characteristics to model effects such as heat 
build-up. 

20 Preferably, each distortion module 312 independently models a form of distortion. 

In FIG. 3, the first distortion module 3 12A models amplifier clipping by enforcing a hard 
limit on signal amplitudes. Thus, this distortion module 312A models the effects of the 
speaker amphfier 216 in the terminal 1 10 on the analog signal sent to the loudspeaker 
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118. The second distortion module 3 12B models loudspeaker 1 1 8 voice coil (or 
equivalent structure) displacement. In one embodiment, this distortion module 312B 
estimates the nonlinear relationship between the voice coil displacement and the driving 
current, hi one embodiment, the driving current estimate received by the voice coil 

5 displacement module 3 12B is generated by the amphfier clipping module 3 12A and so 
may be a nonlinear representation of the loudspeaker digital samples. The third distortion 
module 312C models harmonic distortion introduced by the loudspeaker 1 18. In one 
embodiment, this distortion module 312C applies harmonic distortion with a strength 
modulated by the energy in the spectral components subject to the distortion. Thus, this 

1 0 distortion module 3 12C mimics the operation of a loudspeaker 1 1 8 driven with high 
electrical amphtudes where diaphragms distort and resonate. Other distortion modules 
312 that may be utilized in the modeling path 310 include modules that account for 
distortions introduced by the D/A conversion module 218 and modules that account for 
hysterisis in iron core inductors. 

15 In one embodiment of the present invention, the distortion modules 3 1 2 are 

tailored to model the distortions introduced by specific types of hardware. For example, 
if the AGM 232 is located in the terminal 1 10, the amphfier clipping 3 lOA and voice coil 
displacement 31 OB modules can be specifically tailored for the amphfiers and voice coils 
included in the terminal 110. 

20 The AGM 232 outputs digital sample values representing the distorted audio 

signal to an acoustic echo estimation (AEE) module 234, The AEE module 234 
preferably uses adaptive algorithms to adapt the digital samples to compensate for 
substantially linear changes in the echo characteristics of the environment in which the 
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loudspeaker 118 and microphone 1 16 are located. For example, the AEE module 234 can 
modify the digital samples to account for changes in echo attenuation due to relocation of 
people in the vicinity of the microphone 116. 

The digital sample values output by the AEE module 234 are preferably received 
5 by an audio sensing module (ASM) 236. The ASM 236 preferably modifies the digital 
sample values to model distortions that can occur in the process of sensing the audio 
signal. Like the AGM 232, the ASM 236 preferably includes a modeling path comprised 
of logical interconnects among one or more distortion modules. The modeling path for 
the ASM 236 is not shown in the figures because it would be redundant in view of FIG. 3, 

10 Also like the AGM 232, the ASM 236 preferably models substantially nonlinear 
distortions. Unlike the AGM 232, the ASM preferably models distortions such as 
microphone 116 centerclipping, amplifier zero crossing distortion, saturation in either the 
microphone or the ampUfier, and/or distortions introduced by the AID converter 214. The 
output of the ASM 236 is provided to the adder module 220 and becomes the input signal 

1 5 representing the echo from the loudspeaker 118 estimated to be present in the microphone 
signal described above. 

Accordingly, the AEC module 210 of the present invention accurately models the 
effects of distortion on the audio signals. The modeled types of distortion include 
nonlinear distortions introduced while generating and sensing the audio signal and linear 

20 echoes introduced responsive to room characteristics. This distortion modehng enables 
the AEC to more accurately cancel the echo in the signal received from the microphone 
116. 
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The above description is included to illustrate the operation of the preferred 
embodiments and is not meant to limit the scope of the invention. The scope of the 
invention is to be limited only by the following claims. From the above discussion, many 
variations will be apparent to one skilled in the relevant art that would yet be 
encompassed by the spirit and scope of the invention. 
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Claims 

I claim: 


1 LA module in an audio communications system, comprising: 

2 a first input for receiving a first audio signal; 

3 a second input for receiving a second audio signal, wherein at least a portion 

4 of the second audio signal is an echo of the first audio signal; 

5 a distortion module receiving the first audio signal, the distortion module 

6 adapted to model a distortion on the first audio signal and produce a 

7 distorted signal; and 

8 an adder module for receiving the distorted signal and the second audio signal 

9 and adapted to use the distorted signal to remove at least part of the 
10 echo fi*om the second audio signal. 

1 2. The module of claim 1 , wherein the first and second audio signals bear 

2 sequencing information and wherein the adder module is adapted to use the sequencing 

3 information to remove at least part of the echo fi"om the second audio signal. 

1 3 . The module of claim 1 , fixrther comprising: 

2 an audio generation module receiving the first audio signal and adapted to use 

3 the distortion module to model a distortion that occurs responsive to 

4 playing the first audio signal through a loudspeaker. 

1 4. The module of claim 3, wherein the audio generation module comprises: 

2 a modeling path having one or more distortion modules that model distortions 

3 on the first audio signal, 

1 5. The module of claim 4, wherein each distortion module models a different 


2 type of distortion. 
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1 6. The module of claim 4, wherein the audio generation module alters the 

2 modeling path in real-time responsive to distortions that may occur on the first audio 

3 signal. 

1 7. The module of claim 3, wherein the distortion module models an effect of 

2 ampHfier clipping on the first audio signal. 

1 8. The module of claim 3, wherein the distortion module models an effect of 

2 voice coil displacement on sound pressure waves produced by the loudspeaker responsive 

3 to the first audio signal 

1 9. The module of claim 3, wherein the distortion module models an effect of 

2 hysterisis in an iron core inductor on the first audio signal. 

1 1 0. The module of claim 3, wherein the distortion module models an effect of 

2 harmonic distortion on sound pressure waves produced by the loudspeaker responsive to 

3 the first audio signal. 

1 1 L The module of claim 1 , fixrther comprising: 

2 an acoustic echo estimation module receiving the first audio signal and for 

3 adapting the first audio signal to compensate for substantially linear 

4 changes in the second audio signal. 

1 12, The module of claim 1 , fiuther comprising: 

2 an audio sensing module receiving the first audio signal and adapted to use the 

3 distortion module to model a distortion that occurs responsive to 

4 sensing the second audio signal. 

1 13. The module of claim 12, wherein the audio sensing module comprises: 

2 a modeling path having one or more distortion modules that model distortions 

3 on the second audio signal. 
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1 14. The module of claim 13, wherein each distortion module models a 

2 different type of distortion. 

1 15. The module of claim 13, wherein the audio sensing module alters the 

2 modeling path in real-time responsive to distortions that may occur on the second audio 

3 signal. 

1 16. The module of claim 12, wherein the distortion module models an effect 

2 of microphone centerclipping on the second audio signal. 

1 17. The module of claim 12, wherein the distortion module models an effect 

2 of amphfier zero crossing distortion on the second audio signal. 

1 18. The module of claim 1 , wherein the distortion module models a pre- 

2 established distortion. 

1 19. The module of claim 1 , wherein the distortion module is adaptive. 

1 20. The module of claim 1 , wherein the distortion module models a nonlinear 

2 distortion. 

1 21. The module of claim 1 , wherein the distortion module operates in a 

2 frequency domain. 

1 22. A method of canceHng an echo in an audio signal, comprising the steps of: 

2 receiving a first audio signal; 

3 receiving a second audio signal, wherein at least a portion of the second audio 

4 signal is a distorted echo of the first audio signal; 

5 modeling one or more types of distortions on the first audio signal to produce 

6 a distorted audio signal; and 
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7 subtracting the distorted audio signal from the second audio signal to at least 

8 partially cancel the distorted echo of the first audio signal from the 

9 second audio signal. 

1 23. The method of claim 22, wherein the modeling step comprises the step of: 

2 adaptively modeUng one or more types of distortion. 

1 24. The method of claim 22, wherein the modeling step comprises the step of: 

2 modeling a pre-established type of distortion. 

1 25. The method of claim 22, further comprising the step of: 

2 retrieving sequencing information from the first and second audio signals; 

3 wherein the subtracting step uses the sequencing information to at least 

4 partially cancel the distorted echo of the first audio signal from the 

5 second audio signal. 

1 26. The method of claim 22, wherein the modeling step comprises the step of: 

2 passing the first audio signal through a modeling path comprising one or more 

3 distortion modules, each distortion module applying a type of 

4 distortion to the first audio signal. 

1 27. The method of claim 26, wherein the modeling path models distortions 

2 that occur responsive to playing the first audio signal through a loudspeaker. 

1 28. The method of claim 27, wherein the passing step comprises the step of: 

2 passing the first audio signal through a distortion module that models an effect 

3 of ampHfier clipping on the first audio signal. 
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1 29. The method of claim 27, wherein the passing step comprises the step of: 

2 passing the first audio signal through a distortion module that models an effect 

3 of voice coil displacement on sound pressure waves produced by the 

4 loudspeaker responsive to the first audio signal. 

1 30. The method of claim 27, wherein the passing step comprises the step of: 

2 passing the first audio signal through a distortion module that models an effect 

3 of harmonic distortion on the sound pressure waves produced by the 

4 loudspeaker responsive to the first audio signal. 

1 31. The method of claim 27, wherein the passing step comprises the step of: 

2 passing the first audio signal through a distortion module that models an effect 

3 of hysterisis in inductors containing iron on the first audio signal. 

1 32. The method of claim 26, wherein the modeling path models distortions 

2 that occur responsive to sensing the second audio signal. 

1 33. The method of claim 32, wherein the passing step comprises the step of: 

2 passing the first audio signal through a distortion module that models an effect 

3 of microphone centerclipping on the second audio signal. 

1 34. The module of claim 32, wherein the passing step comprises the step of: 

2 passing the first audio signal through a distortion module that models an effect 

3 of amplifier zero crossing distortion on the second audio signal 

1 35. A terminal for an audio communications system, the terminal comprising: 

2 a loudspeaker for producing sound pressure waves responsive to a received 

3 first signal; 
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4 a microphone for converting sound pressure waves into a second signal, 

5 wherein a portion of the second signal represents an echo of the sound 

6 pressure waves produced by the loudspeaker; 

7 a distortion module receiving the first signal and adapted to modify the first 

8 signal to model a type of distortion to produce a distorted signal; and 

9 an adder module for removing at least a portion of the echo of the sound 

1 0 pressure waves produced by the loudspeaker from the second signal 

1 1 responsive to the distorted signal. 

1 36. The terminal of claim 35, wherein the first and second signals bear 

2 sequencing information and wherein the echo cancellation module is adapted to use the 

3 sequencing information to remove at least part of the echo fi-om the second signal 

1 37. The terminal of claim 35, further comprising: 

2 an audio generation module receiving the first signal and adapted to use the 

3 distortion module to model a distortion that occurs responsive to 

4 playing the first signal through the loudspeaker. 

1 38. The terminal of claim 37, wherein the audio generation module has a 

2 modeling path comprising one or more distortion modules that model distortions on the 

3 first signal. 

1 39. The terminal of claim 38, wherein each of the one or more distortion 

2 modules models a different type of distortion. 

1 40. The terminal of claim 38, wherein the audio generation module alters the 

2 modeling path in real-time responsive to distortions that may occur on the first signal. 

1 41. The terminal of claim 37, wherein the distortion module models an effect 

2 of amphfier clipping on the first signal. 
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1 42. The terminal of claim 37, wherein the distortion module models an effect 

2 of voice coil displacement on the sound pressure waves produced by the loudspeaker. 

1 43. The terminal of claim 37, wherein the distortion module models an effect 

2 of hysterisis in an iron core inductor on the first signal. 

1 44. The terminal of claim 37, wherein the distortion module models an effect 

2 of harmonic distortion introduced by the loudspeaker on the sound pressure waves. 

1 45 . The terminal of claim 3 5 , further comprising: 

2 an acoustic echo estimation module receiving the first signal and for adapting 

3 the first signal to compensate for substantially linear changes in the 

4 second signal. 

1 46. The terminal of claim 35, further comprising: 

2 an audio sensing module receiving the first signal and adapted to use the 

3 distortion module to model a distortion that occurs responsive to 

4 sensing the audio signal. 

1 47. The terminal of claim 46, wherein the audio sensing module has a 

2 modehng path comprising one or more distortion modules that model distortions on the 

3 second signal. 

1 48. The terminal of claim 47, wherein each of the one or more distortion 

2 modules models a different type of distortion. 

1 49. The terminal of claim 47, wherein the audio sensing module alters the 

2 modeling path in real-time responsive to distortions that may occur on the second audio 

3 signal. 
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1 50. The terminal of claim 46, wherein the distortion module models an effect 

2 of microphone centerclipping on the second signal. 

1 51. The terminal of claim 46, wherein the distortion module models an effect 

2 of amplifier zero crossing distortion on the second signal. 
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DISTORTION COMPENSATION IN AN ACOUSTIC ECHO CANCELER 

Abstract of the Disclosure 

An audio communications system has an acoustic echo cancellation (AEG) 
module. The AEC module receives a digital signal sent to a loudspeaker and a digital 
signal received from a microphone. The signal received from the microphone contains an 
echo of the signal played through the loudspeaker. The loudspeaker signal is processed 
5 by an audio generation module (AGM) that models substantially nonlinear distortions that 
can occur while producing the signal played through the loudspeaker. The AGM includes 
a modeling path comprised of one or more distortion modules. Each distortion module 
receives digital samples as input, modifies the samples to model a form of distortion, and 
outputs the modified samples. The output of the AGM is provided to an acoustic echo 

10 estimation (AEE) module that uses adaptive algorithms to compensate for substantially 
linear changes in the echo characteristics of the environment in which the loudspeaker 
and microphone are located. The output of the AEE module is provided to an audio 
sensing module (ASM) that models substantially nonlinear distortions that can occur 
while receiving the signal from the microphone. The digital samples retumed from the 

1 5 microphone, and the output of the ASM, are received by an adder module. The adder 
module subtracts the estimated echo from the samples retumed from the microphone, 
thereby removing at least part of the estimated echo from the microphone signal. 
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